11313331 A 



1/1 




(11) Publication number 11313331 A 



Generated Document 



PATENT ABSTRACTS OF JAPAN 



(21) Application number 11005735 

(22) Application date: 12.01.99 



(51) Intl. CI.: H04N 7/32 H04N 5/92 



(30) Priority: 

(43) Date of application 
publication: 

(84) Designated 
contracting states: 



27.02.98 JP 10 47231 
09.11.99 



(71) Applicant SONY CORP 

(72) Inventor OBATA KOJ1 

IKJ SH1NYA 
KATO MOTOKI 

(74) Representative: 



(54) IMAGE SIGNAL 
PROCESSING SYSTEM, 
DECODER, IMAGE SIGNAL 
PROCESSING METHOD AND 
DECODING METHOD 
(57) Abstract 

PROBLEM TO BE SOLVED: To 
sufficiently suppress the 
deterioration of image quality in the 
case of re-encoding that uses 
compression coding. 



SOLUTION: An MPEG decoder 10 
receives a bit stream as a coded 
image signal, decodes rt and 
generates a decoded image signal 
and gives the signal to a multiplexer 
1 1 and gives a coding parameter 
including a coding bit amount and a 
mean quantization scale used in the 
case of decoding (thus, in the case 
of first coding) to the multiplexer 1 1 
and a terminal 16a. The multiplexer 
1 1 superimposes the parameter 
onto a decoding image signal. An 
output of the multiplexer 11 is fed 
to a separator 1 3 via a 
recording/reproducing system, 
where the coding parameter is 
separated and fed to a terminal 1 6b. 
On the other hand, an image signal 
is fed from the separator 1 3 to an 
MPEG encoder 14. A switch 15 is 
thrown to the position of the 
terminal 1 6b to re-encode the data 
by using the coding parameter used 
for the first coding. 
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XA = — (2) 

I x_mb (nh__ f) 

[0 04 8 ] CCt, t a r g e t__b i U3\ ^Sx_mb (mb_ i J tt, tlTOS (3) &Ct£oTft 

& 0 m b _ i f f t (C»T4^tIi^ [»33 

x_mb[mb_i] = fbit[aibj] x weight_fltb[mb_i] (3) 

[0 05 0 ] CCr, f b i t [rab_i ] te, MB£ ★ i ] tt, iBIfc^fcOBSt^^r S tSVjv^-rf- 2T*$> 
■O^BHI-C**. fbi t [mb_i] ©St*«, I Sfc, NMBte. 7 Art<D^P^n 9 ^<Z> 

l>. P. BK^JtKo^tB:, ■flkHIOTflHS [0 0 5 1 ] 

*tca-^l»rtf 9. i/c, weight^mb [mb_* [1*4] 

2xb i t_ rate 

KR = C4J 

f r am e r a t e x 3 1 

[0 05 2] CCX1\ f r ame_r a t e tt, 1 #S ( 5 ) fcfEoTfff*T5. 

Jt0O7U-A»t*4 Q [0 0 5 4 ] 

[0 053 ] Xf ^*S10 5m mb_i [»53 

target Jbit _mb[mb _i] = XA x x_mb[mb _ij (5) 
[0 05 5 ] CCr, target.bi t _m b [ m ♦ B©^*a:/P * ^tc*fT S«^ffc**~A>*finF©3C 

b__i ] #mb_i#S<Dfl^Tfc^ hS"C4>^ 0 $ ( 6 ) CCfE^rMrr 

fc. <RHWfctt»!t x_mb [mb__i ] » % ±&(DjZ 30 [0 0 5 7 ] 
(3) fcffioTM*3*l*. t»6] 
[0 056] Xf^'S106tlt mb_if* 

««wltj = — , cs; 

KR x XA x *eight_mb[mb_i] 

[0 05 8 ] CCt, mQ [mb_i ] ^mb_i#g * [0 0 5 9] Xf^7'Sl 07m rab_ iSgOv 

fc. KR. XA, weight_mb [mb_i]«± y 7 S 1 0 8 tc**? U ^1?##{fc^^~££.iy 

M*U/c&<D-C&£ 0 mb_if|(Dm^ T©S < 7 > KfifroTJBBrT*. 

Cmb_iD ti* ±2L/cXf 1 0 40 [0 0 6 0 ] 

KQ[fDb_i+1J = -f framG_bit_generated[wb_i] 

— sum_target_bit_ mb[mb_i] (7) 

[006 1 ] CCt, f r am e_b i t _g e n e r 

a t e d [mb_i](t JgSOt^f t©mb„i # [0 0 6 2 ] #tC, Xf » :/S 1 09m mb_i(C 

um_t arget_b i t__mb [mb_i]^ m T£o ^f"^7"S 1 1 Otcte^Tte. mb_i 

b_ i *@cr>v*n:/n y ?£-C<Dt&&\^X¥y hit' 50 ifi 1 + ^/c9 p:/p ^ ^©H»NMB«tO 



(8) 1 1 -3 1 3 33 1 

13 14 

*£t>a>5#>£*lJ5E-r-5. mb_ i A^NMB^O *ffite. y V'S 1 0 4 tCfcUT. ^fiiMtX^-./U 

iflJ^bfcJ^lCli. ^©fc-^+KitfT&^S^T A^ltS^tlS OS ( 1 ) #BS) . 

UtctPMU. Xf»;7'S 1 1 ltC^fT-5. — m [0 06 5 ] C<Dfi8K^3*T,5^S^fc^y-JK73 

b_i *iNMBJWTr&££¥^Lfctl£K:«:. X-r*./ fltt. ±a>L/fc<fc 5 tm&LlC i -^Tg&SiiS. 

[0 063] Xf ? 7'S 1 1 1 tcijOTte. ±T£Ltc¥ X^-;b©ffik;S-3l,>Tj§#J& U- P =>> p p-jI^t 

>ft<MR*wtP i c t_i {Cl *mj>rs. 2 6 *>ft. ^©ij&UliLT. Hx>=i-F©BSf»r??#ftt 

^7.f-->7'S 1 1 2 (CftfLT, pi c t_i Sri&ffi© ? Pfi£— aS#4*UflPa*WffeT&£>. 

m{4<bf 5Wft IS. fliRtfl GOPSfcDCti'f 10 [0 06 6] ±^©^^1*. Sx>3-KOi9 

+ ©te»NP I CT±0^*l>*>S5*«S«ST5. XT' ftTt*? tfflfiHWfct:* hS£-St;*-t±.2>t§££t&BJ 

ytT'S 1 0 2(C*jUTp i c t_i#NP I CTJWTT' LtcfiK fli>3- F4 0t}HffcK» 

ibht%m{s-tcW&lC\Z, Xr?7'S 1 0 2lCWrtLX MT^JS^©L'-F=i>FC3-^i^?:|^B > g-r^ (> 

»i^© (T&fr^P i c t_i rtUifflnb/c) t'i'^t ©$m«. 15©70-?-t- P <i|5)0-C& «3 . Xf 5 

{c^rs^as^ra^-r-s. — 1 1 2tc*j 1 0 2t^f^s 1 0 4-r©saa©iMi*>L^s* s 

l>tp i c t_ i #NP I CTJcDAttii^b/cJa ^fc*. 

^cc«. ^©GOP^MS^feKStT-stoa^Ti, [oo67] -r^^^. 7ti<Dnmtv-j fx 

fcilflliir, x>ra- F'^T-TS. P 'J -A©f f P P £R 1 t U ^n^ffx>3- 

[0 0 64] &±©«fc5fcU- Pp> hD-;l/©^I(C FOrffS^ffctr^ FX F y-ACDt? F U- P£R 

*sl>T. mb_ i #a©-7i7pyp^ ^K^-T^^a© 20 2itSi#- iSO^O-ft-hC^f-^'SlO 

ttKKW«*4mb_i*B(DM^fcX*-JUtt. *r- 2X<D\f 9 + + <Dm^X\Z •> HC^li. ^©^ 

•?7*S 1 0 6^*jl>Tft^5tlS„ -eLT. C©lt#© (8) KS-?l»-tm>*l-5. 

/cest>4C. ?St^bt7><-d'CD»sffifflSn5 (5£ [0 06 8] 

<6)#JCR). CWWfiWk'f?^-*!*. [|S8] 

s i o 8 tctec^-cMiFf (j£ ( 7 ) #M) 

iarget_bit = picture_bit_siz» X R2/R 1 (8) 

[0 069] CCtJ, picture _bit_siz * 1 0 AX<D^mn^il^ ^- ^©tO*iffi^©J: 5tC 

el*. 7C*©flHWfct? FX F 'J-AObr^^-f ©^ taSTf-S. Ctitt. ±j$©5£ ( 1 ) ©KQ t 1 ] ©tFff 

{fctr FS-C*0. target.bi tti, Bx> £&©-?$> -5 „ 

=3- VrZVZ + vOymikxyZ'j FS-Cfc-5. 30 [0 07 1 ] 
[0 070] g/c, |5<D7D-?t- P©X-r ;-:/S*: [|S9] 

M?r x picture_bit_size = XMQT x target_bit 

KQ CO = XMQT x KR x XA x weightjnb CV (9) 



[0 072] CCtMQTtt. 7E*©*HHttf9 FX F 
>; - A<D¥l^lS^tX>r-;I/T'* &„ -e©ffi©^ISW5t 

torn i/ tdm. t m c tsft-c* s. 

[0 073] MPEGCl^tW, t^ + ^-Y 

7 b-ArtfHfftQntra) 7i'a7'D-;i'i, jg 40 
£^6*#£^iJ:r3iit£fi (Forward) 7 U-ABSJ^ffi'J 

a^^S'J-T ^rtJf W (Interpol ati ve) 7^07D^i 

[0 0 74] It^?trt(04T©77a^P^B, 
^U-Art^ft^i'P^Pyi'TN&.S. gfc. Pt^ 
^fpSltcw. 7 u-AFW-^fbv#p:/p ftWift 
7 U-APbI^JV^P^P ^tAs^^nSo 



[0 07 5] C©26BJ«. J:«J*»W«:f3:. A^sns 

[0076] *-r\ immnmommtmmc-o^xin 

*«##it»ett&Sn. $/c. A*i*?6 2Klt7tn 

^ T^T-j-x&mvtd&mmm^mx&z. r-ru 



(9) 

15 

ISH«^*IJ®S|J64^UTMPEGi>3-^65K: 

[0077] m&m^pmne 4tb, ^.-if-©^ 

D^&SIS6 Sa^Cfw^^lWtiA;^ A*4ffi^6 1 
*>6A*?tx5-r-Y y^JU^A^^l^n— o^rjltR 
UMPEGI>3-^6 5KWI.. MPEGx> 

3-^6 5B, mmm ^wmi 6 4 e.©^t -^^^ 

UTMPEGteJ:£JEIf^1"t£SSTJ\ 10 
[0 07 8 ] MPEGiy^-^eSt'HlJhfcf-i 

5-7 stciorsirisisn-sy^e'jSfijffljgiJe 7tc«tOT f 

l^A^g^Sft, 9 7 r V 6 6 ©!2«k^ffl/< 

9 7 7^*'jgp66 ajcts^fts. 

[0 07 9] m$mm^ 9 V r J * >; 936 6 a 

n/cf^-Y i/df ;n^ff-^«, ^x. -^-^i/msse 8& 

?>*1B»?I£$J#*X 69 U-CtEt 5 ^i>F5 
^^tc«^§n^„ :f-##yisiJ6 8tt. IBiWt^a 

g|J 6 8 a i fS£ff ^^aSP 6 8 b o f EiSHi^ 20 

IIg(56 8 aW. x^-fTjE^-ffc. 7^ ^£;l/gEIi)^© 
j&ffl^fC^ #£ls-S|J£iIg&6 8 b«. x^-ITiE. 7* 

i>tc*h<b%^ s F7 0i> #7* ^?71* 

9 K 7 0 £X b*> K;U^r- ^7 2it i?/^ 9 

F»I»8B7 3 iCj: 0 MffllS » F 7 0 

•c . mm^wmn 6 8a (DtaMs-miw? ^^71 30 

■C. MO (tKJK*) f^?, mtitMyt-iXtm*®. 
[0 0 8 0 ] yXrA^y hP-57 5W, Icf^* 

f 7 ^©sw^t 1 Fftotm 7 3 

0 . -£©t»*& ^ * y 6 7 teg* . 5. V y 

y^ey e e*^©^-*©^©*!]®^ 5. 
[0 0 8 1 ] :xcc. w^tefflsRccooriiWJ'S. ff£ 
tiPMmZ. b -CiS^S y v r y * y 6 6 ©Si 40 

^fB'-w 7 r sis 6 6 b a> s nss^ft-^?: 

fjl-^-T&MPE Gf^ — #7 7 i. MPEGfr-^7 
7*6©»fWW3^*tt9iM.*R«fi-91WW«6 4 
£ . RtttflPHHlfflSIS 64fW0^?. ftfcHMM&** T 

j-n a^wfc«tt:saftr« D/Agaft8P7 9 ££<ixt 

[0 0 8 2 ] FB#, %<f-(7.>? b'^AVit. -r 

■r x PMgptt 7 3 «: J: 0 -y— ^9 F&K&^ 

#ff?ijffl $ n . £ft-5i % 7 s - * MSSB 6 8 <Dm$imm& 



=f#P8¥ 1 1 -3 1 3 3 3 1 
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6 blCtiit)ti>. n±?km^K>yr^^V^e 6 btt. 

i?£{f-*f©»£ £ m^m u ©^'^ > ^ <o 

£>. B4RM#4MPEGf3-y7 

MP EGf^-^7 7tt, «4fi^L.TMPEGa 

[0 0 8 3] 0*fftff -*t$«SP6 4 K. a— tf©RS«ct£ 
■o-C«4«l1»«#AAaJ7 6 *rt-L-CHfc1t«fc»-3t> 
/cVXt-A=j> l-n-77 StCi^Pffl^ti^ MPEG 

*ttL. !S-9»flMl^%D/Aa»»7 9X»ai*iSHf- 

7 8KtfJ#T£. D/ASSft»7 9 tt. Rtttfl#«f8lS|S 

6 4 -cm y »ii ftofan swcf^^ Jim^mm t+v 

[0 084] Kftfi-^(M»SiS6 4 tt. ^JO Jft^X ^ 9 ? 
SWli^t)MX-i-;fSW2i;!pf l %S. <?jy^x. 
X-fi-fSWlS, A*liS^6 1^6©^-* i?*;l<Wfe 
'm#A**««l&Sn*A*«Hf-ai. A/DSE»»6 3 

MP 7 3&>e©«^»Wlt(B-^*4«*frStl* 

AA^Fct. MPEGi>a-^6 5KB!l!iM4A 

9^SW2ii, A^)S3^6 1^6©^ -<-^^ ^8*^1-^ 
«3ti5A^ei, MPEGf3-^77*P> 

©fs^i^^fi^^^ $ n ^ a^js^ f <b . w,t>m- 7 

8 SO' D / A^gB 7 9 tc m&m^Z tUtt S tH^jiST- 

[0 08 5 ] C©!5ll«^#*iJ©S?6 4 (CfcWSX A -j * 
SWIWA-f 9^SW2©^jy}^li. ^?A3> 

3>ha-775 tclS^$iJtaift-^A^gP7 4 ^ bt« 

jHBm»«#JS5&r -s «> ©f*nti. x 9 9^ s 
wi©A*Wf-a*ja*aBT-d«:fia«sn*. *ic. a 

^*S^6 2 ^6©?*#ff^?:JiS-rS fe©T*tl«. A 
[0 08 6 ] ^?>iC. {5]n^©B!t!®A^ iTfer-/ F 

47,tfi 1 tc!B&-r££i>5ig<&-e*ft«. ^tA3 

>Fn-775 AStt^S^ 1 d ^ A^JraT- c CCgi^-r 5 $ 
A 5 >^«r«ffl|-r*. ttitt, MPEGf3-?7 7 
*>6©iX-^m2)£B:&MPEGi>3--2'6 5«:«*& 

[ 0 0 8 7 ] ftfc. C©0MMI#lBJ§B££gat2. IB A 

^r^^'jeei. fBSS*- FX«Wi*- FJCf&D-C 
9 7 t y * y 6 6 ©IBtt$IJ|!(SlJ^TMffiA^>X 7- 
A=t>hD-5 7 5tcJ:»)WfflIS*i4. -T^cfc^^ SBJi 
3Sffl^<9 7T^*ySB66a iStW^r^t'J 



(10) 



17 



a-^7 5©fMfflKC«fc*). -fOi'JT^ifS. P!l 

«. ^^*7 7y*'J6 6©:£-c££«>&. £fc. W 
[0088] ztc. c<Dfttmcj:z>mz.y=>- F*mm 

255 



imW- 1 1 - 3 1 3 3 3 1 
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[0 08 9] JWC. t*©Sx>3- F*Jt«S**4 L/ 
JtlStt. BIB*MfflfflIiBffl«j($ (CC1R)©I 

(ftis—trl/Z. (bus. bicycle, mobil Seal ender, flower 
qardeaRO'cheerleader) &C-3t,*T?|i>3 — K?:!fo 
/cB$©SNR (Signal Nioze Rate)*flH>Ttf 5 . 1 li 
?c K> 8 £ F (Dlffiflttt #tC -3 1, >T . S N R tt#T© 

s(io) (tfto-cismsj-is. 

[0 09 0] 
[&1 0] 



S/W = 20109 



[dBj 



MeanError 

[009 1] CCt, pixel.numaif^t 5K 
^t<L*)<DW9mX'3bZ>. $/c. MeanErrorttl 
H*i!ifc9©¥*3tt&*9«-ca!). «T©5$ (11)« 



no; 



[0 092] 
[SU 1 ] 



MeanError = 



SumError 
^ pixel_num 



(1 1) 



[0093] tCC SumError^IftC-Jli i 

n^c ★ 

p r xw I n urn- I 

SumError = I fOrgi - Cun / 

t —o 

[0095] CCC, Org, li* 'J yt*i«© i S 
-So * fc. Cur, W&^VcW&G) i # 
@©iS3K{iI-c&&„ 

[0096] mite, n -J y'&ZffflZ b)is 

KH#iafi3<DJ.>="- KH^i-C— iSc^itr 30 
^•5>fi£*cDf|x>n- K<b. £*? + 

^©x>n- FB$£^— &3trT&£C©^H;3K:J;&«: 
x>=i- Kitc-o^T. S NR©tb§x©— ■PH^L/Zc. 
5fI©^--^>.x©{5JftCc-2U-c4>, c<D&mtJ:2>ft 

*J 9 . C ©«W*W*m©«nWKWj&T* 4 C i ifit> 

[0 097] Sfc. ^8tC. f>fi'$-/7 - ©WBx 
>=t- F«Fi«fi]©i>3- KB#<b-C— Sfc;**!"CSc&& 40 
5fc©l? X > n - F £ . f^^+^-f ^KjJD*. T^^t b* 
9 H4^i>3- KB#i*tt©x>3- FB#iT?— 
aS-ST)5c«CC!5«W(CJ:S»x>3-F(C-3^-C. S 
NR©itf&©— WZTjkLtc. m8lCte\.*Xi>. 5fi©-> 
-^>^©f5]tlOCOl>T 1 bC©^(Cd:-S|fx>=i- F 
£tTo/d*£©SNR©:£#?St>{i£^UT:te«)> C© 
^dsiiM^k©jq)$iJ«:^r*Sc: 

[0 09 8] 

=i-FB#tc, A*sn^^tii^fi^©#^b^*7y so 



[0 094] 
[fitl 2] 

**t?*-5. -en(CJ:D> Sx>P-FB#£SflJ©x>3 
- FNf{COli"Cl?#{fcf 9 hS€:-aSi±^C£^-r-# 

[0 0 9 9 ] — x>=j- FtC*JWSU- hn> 

r p -;u«iij^©^^tgtSgtci£:D-cS&o/cfe©c: 

r. c©<t9^^{bf ? h«©SOb*Wx>=i-FK: 
*iWSilM^b^D^-a-S„ Si>3- 
FB$£ft^©i>rJ- FB#©^^bt*9 bS^r-^^if 
S±aj©^il(cj;^-r. BKH96<t*«W-i-iCt*i"C* 

[OlOOlifc, C©«fc^tCLr^-^fct» hM- 

r«. si>3- Fow^-cabir^f hju?:— gc^-t+s 



19 



fSis^aa-'fi^ x h <t-r s c <t wet *©-c. mm±w 

[0 1 ] e©#SW©-5lliflH»«co(,>Ti»B*S;fc«>© 

[13] ccd^cd^ ^cmomMnmic-o^xm.m-r 

[05] C©^iECCcfcSBx>3-K«::teW&l'-h:3* 



(11) #H¥ 1 1 -3 1 3 33 1 

20 

[06] c©«W*afflTS££#r*siffl*S-i§*!yi 

[07] n<D§m<r>sfo%a>— wt-i^xmm? z>tc&><D 
[0 8 ] xL<D§m<Dn%&>m>— mK.-o^x^mr?>tc 

[09] \r<DM1k*C\Z + W(.L 

1. 11 2>mV&. 13 #Hi§. 14. 2 1, 3 1 
MPEGi>3-^ 2 3, 3 4 ftmtVv YM.U 



1 ] 



[09] 



J i t Stream 

Jj~ MPEG 



Pe r ameter 



Decodf 



1 0 



T 
1 1 



i— tt 




r 

12 13 



BltStreBra 
MPEG 1 f t 



Encode r 



HHaOlHHHIDBHHHaBB 



B |BlBlHB|B|P|B|B|P|B|B|P|B|BlP| 
C 



□□□□□□□□□□□□□□ 



[02] 



[03] 



B I I Strean 



22 



23 
J. 



20 



WW* 



V 



< 




MPEG 
Decode r 






MPEG 






Encoder 



Bit S treat* 



1 1 St ream 



33- 



-32 



34' 



MPEG 


\ , 


MPEG 


Decoder 




Encoder 



37 



8 i t S t r earn 

( 



[07] 





[ dB 1 


[ dB 1 


bus 


3 5.28 


35.48 


bicycles 


30.59 


31.40 


mob l 1 e& calender 


31.16 


31.74 


1 lowergarden 


34.21 


34. 56 


cheer leader 


32. 55 


3 3.23 



«fH¥ 1 1 - 3 1 3 3 3 1 



[04] 



IH5] 



I 



-SI 



-S2 



-S3 




(START) 



S102- 



SI 01 — I B ict_i:l 

— E — 



plot - i$@a>fcf^*G) 



si03- j~^b7"Trn 



S105- 



SI 06H" 



mb_ lS@(DMB(DW^r 

I 



ib_ i Seoffi-f 4k 

3T^ 



S1D7-H m b _ l#B0DMB^«^b 

— T 

SI mb- i+ + | 

m b _ I >NMBJ 

SI 1 1— f piet". i++| 
SI 12s 



(ENDj 



NO 




[06] 



61 



6 ^ 



79 
6-D/A 



78 



74 



64 

Ftrh 



SWT 



SW2 



65 



MPEG _ 



MPEG 



76 



I 6 



— B 6 a 



■N.66b 




(13) #HJ¥ 1 1 - 3 1 3 3 3 1 



[B8] 





[ dB ] 


[ dB ) 


bus 


3 5.09 


3 5. 1 4 


b i c y c lea 


30.38 


30. 78 


mob i 1 e&ca lender 


31.05 


31.51 


nowergorden 


34.06 


34. 26 


cheer leader 


32.34 


32. 76 



